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Ihree commonly nsed infbrma^ reading invento'ries were 
examined to determine the exteBt to* which t^ir comprehend test 

V. gu^tibns were passage independent; _and could be ahsweire^ correctly^ . 
without xje^ding^ 'the passages on w^hich^ they 'were Jbasedi Fo^th graders 
we^f given the questions bralljf. without access 'to. the passages^ The 

. percentage of questions answered correctly was calculated* for each 
,$€Sti an 'analysis of variance prbfcedure . revealed that the Classropm 

^:5eadi5g inventory was the m^ passage_independent folloired by the 
'inalytlcal Beading inventory acd Siniv. 720 basal^ inventory ; 
respectively* in analysis of children • s responses td,_ the questions 
revealed that three^question types in : particular tended .to . be passage 
independent in. nature. These question categories^ werei (11 general 
infdrmaticn: ^2) ^ vocabulary meaning: and (|[ -affective* Ehe 
anvestigation also ^examined the degree to which^the respective 
inventci^y comprehension questicns provided inflated estimates of the 
children's reading cdmpriSlnsibn abilities. . (Author /GK) 
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A PASSASE INDEPENDENCY ANALYSIS OF THREE INPeRMAb READING INVENTORIES 



%fee commonly : used informal reading inventor.ies.were exami 



to 



ue'te.';n-ne the extent to which their comprehension test questions weri passage 
wo&Ki. -nt, could.be answered correctly without reading the passages on 
,w:r- ^.- v4-^were^ased. Fourth graders were given the questions orally without 
aeees5 to the ^-.^iSag€S. The percentage'of questions answered correctly was 
caV-^'ited for each test. An analysis ^of variance procedure revealed that the 
Class^co^njead&s^^fl-v^^ the most passage, independent followed by the 
Analvt.ra l Reading Inv€Btory .and Einn 720 basal inventory respectively. An 
analysis ef children's responses to the questions revealed that three question. 
tyj3es in o/rticu^ar tended to be passage independent in nature. Thge- question 



categories we-t: -a) ge^.^ral informatidrv b) vocabulary meaning and q-:affective. 
The,investigati.-)*i also examined the degree to which the respective "irrventdry 
comprehension, questions prcvided inflated estimates of the children's reading 
bomprehension abilities'. . . ' 



* Paper presented at -the National Reading Conference in December 1979. 
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' . * Readin3.speeiaT#sts arid classroom teachers. conSonly . ajjminister in^br^^ reading 

^ ' ■■ - . ^ _ _ _ " • . _ , 

inventories (IRIs*) to assess a student's strengths anpl weal<ngsses in reading. 

These •inventori-es ire alsQ used to identify a general Tevel of reading. pnoficiency 

for plaeemiht in^appropriate instructional materials. If teachers arte, to have 

- confidence, in €he quality of these assessments and subsequent instruetiohal . 

decisions^ they need to be'certain that the ineasures they are using are valid. 

• ^ « * ^ • ■ * - 

In;|ormal heading inventories provide^ number of estimates including sight 

word vdcabuTaryi oral reading accuracy, fluency, rate aad comprehension. The- 

. - " .' ' ■ - % 

flatter was of partieular . interesf'in .this invpstigation./ Typically reading ^ 



compre|ension refer to an indivitfuaVs ability to understand text. In recent • 
years considerable attention has.^been given to passage fndependency, the extent 
to whicli questions'can ^e answered j^rectly without reading thf . passages on 
which they are based eJbhns, 1978f Pyrczak, 197?,1974).* If" test questions canbe 



V answered wiWiout reading the correspon€Tti5 passages^ tt is argueH that the test 

_ * * 

-does not reaily -meaTsure reading comprehension,^ but rather prior knowledge. Thus, 
. - - ' .' " - • - - ' _ - -_ ^ . - 

an adequate tqnitirehinsion score .may not reflect, the extent to which a student has 

under-stbod the passage^ but merely his/her ability to remember informatfoh abd}^ 



the toptc. 



|ERic^:^ ^ . ^^^^^^^^ : • 4. 



' ^ . : ^ V " * ::• - ' Ma^f - page 2 

•r ' - ' ■ * . ' - 

i** • ." - : • 

■ " R^seafehefs hasfe found -that several ebmmonly used cqslprehension tests are 
.* in'fact passage- independent. Preston (1964). Tuinrain t^973^1974). and Sehenaic v 

and ifanna (1977) examined standardized reading achievement tests such as the 
: Nelson Penny Readi riq Skills Jest and the Cobperative .English -Test and found that 
. students were abl^ to answer compj^ehension test^question's a^ove the chance ^evel 
without reading- the corresponding paragraphs, Anin^toK,. Gjiodds, Doiriaracki and 
Truex 0977) found similar results when examining four diagnostic reading tests: 
the Soache Diagnostic Readfng Scale s^ the n.irrpll Analysis of R eadiag^ffieulty • 
and the Silmore arig^ Gfav Oral Readi-ng^^ests . Reading comprehension exercises 
- including the leaders -Eiiges:t Skill Builder series and the SeEaTl -Crabbs yndard>- 
. Lessons in Reading hav^ also Be^ found to Be passage independent [Pyrezal^ & 
Axelrodi 19-76). In light of these findings it has Become incre.asingly apparent 
■ "that questfbns can in fact Be passage independent thus-reducin"^ their. validity 
as a mejisure of comprehension, the intent of the present study was -to evaluate 
the passage independency of questions. taken froiri three conSonly used informal 
reading' fnventories: the Claisrdom^eading Inventory GCRI) Form B, Fpurth edition 
By Si IVarol 1^0978):, th^^ ^alvtical Readin^^In^entory CARD. Form C, by Woods and 
• Moe C1977) and the fidnn 7^0 Basal Inventory CGi-nn and eompany, 1976). To date 
this type of IRI evaluation has riot Beerr uridertaken. A second. focus pf the study 
was 'to identify^ passage- i-ndependenr question types; therefore, an :analysis of - 

' . _ 

Student responses to specific questions 'was conducted. : 
■ ' ' • ■ • Method 

SuB^jects ' . 

. thirty-^ix -fourth grade studentk from a rural school ia upstate -New- York 
' participated iri the study, 'They were stratified randomly into one of - three IRI 
test groups wherein there was an equal number of good and :pbor readers. Reading 
ability wrs«deterniiried By perfonriances aBbv-e or below gr'ade level bri Bath 
" vbeabulary arid comprehension subtests of the Iowa Test bf Basic 
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\ Procedure ' > " - ■. ' ; ' • 

•All chi^fen V/er"e test^sd Cndividually using a" randomly selected fdrtn 
(AiB of ej of each inventory, t-ast questions .were read orally to 'tf^g childr en' 
according to thfe inventory test prQcedures . However^ children did not have, 
access to the passages from which th^ q-<^stions were -derived. The order for 
presenting questions within each- level (primer i-.hrough sixth. grade) was maintained 
as in the original inventories; But the levels were presented in one of two 
Randomized orders to avoid making the testing task .Sne^of increasing difficulty 
for the students. Children's responses to the questioi>s were. tape recorded a^d 
'^f' 'later transcribed for evaluation. : ■ , . . 

Results and eisctission 

' , Due to the unequal number of questions contained in. the three inventories,- , 
- ■ - the percentage of items^answered correctly was determined for each test. "An 
"analysis of variance proced'ure. was conducted to determine .if_these percentages. 
- wefe'in fact significantly different'^fronj one another. The results indicated ^ 
that performances across the three 'tests Were, different, F C2,30] = 15.-558, 
p^ .001. The CRI was found to be the most passage independent Gx = 26.2731 
: followed by the ARI ^ MASSl and .Ginn inventories C5c' = 11 .4551 respectively.. 
Newmah-Keuls post hoe eo'ntrasts revealed that each- of these mean pereentage scores 
were significantly different from one another. These results point out that 

I f ■ ■ . _______ ^ J *_ . ' \_ 

although all three tests were found to be passage independent to some degree, the\ 
\ eRI contained the greatest nurnber-.of pa^ssage independent questions C26%1 and the 

Ginn inventory the. fewest (11%!^ Thus, the extent to which eomprehensi^in scores 

could be inflated oh these te^ts varied sighificaritly. > - ~. . 

' ' . Ah item analyses revealed tv?o ihterestihg types of information: lithe" 

number of children able to test out of a particular reading .levels by answering 
• passage -independent questibhs correctly and 21 the types of questions which, were 

passage independent in hatufe; . ' ' , ; 



■■ On. the 6ompreherisieri subtest of the CRU an instructional rtadl rig level 

• ■ _ _ _ _ _ • 

cutoff score is 60%, correct. Ah item a/ialysis revealed that at. level #1 of 

the testi 50^ of the children passed the iristructienal reading level criterion 

withoat ever reading the .passages". At jevels #2 and #4, 25% of the students 

passed the criterion score. Based upon these, percentages; one could predict 

that if one hundred cfrildren were tested, fifty would test out of level #1 

and tweaty-five out .of levelr, f^and #4 without reading the passages. These 

findings lend corisiderable question as to the validity of this comprehension 



measure. 



The riuitiBer of children passing the'^riterion score for the^ARI and 6inn 
inventories was eons-derably less. On the ARI epproxiniateiy33% of the students 
1 scored above criterion at level §2 witftoiir reading the paragraphs. However, they 
•did not test out of the other grade levels ori this inventory. On the Sinn 
inventory, two^ildren passed the critiFion score at level while at^levels 
.#6 and* #9 only one child was able to meet the criterion without reading the • : 
corresponding paragraphs. • - ' • 

Qf the three tests examined the CRI^appears to be the least valid; measure of 
text comprehension. It not only contains the greatest number .of passage independent 
questions which results in students passing comprehension criterion levels without 
ever reading the passages. It also provides' the teacher with an inflated estimate 
of the student's compreheiasfofi- ability and thus increases the probability that 
the student will be placed in instructional :;iaterials at an inappropriate level ef 

difficutly. ^ . ^ ' ' , ■ ^ 

Examination of the,^ypes* of questions which were passage independent reveals 
. some definite patterns? The questions listed in Tabfe 1 tend to fall into three 

* ' / . Insert Table 1 About here / ' ' : i, 

general categories.: 1) general information 2) vgeabulary meaning 3) affective. • 

. • * _ _ ■ _ ■ _ 

The general iriforaation questions appear to tap information" about familiar topics 

« ^ _ . _____ 

of prior experfencis as evtdenced by the questions: " WBere do ants 1ije? Wfiat are 
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sb5ne>*ways ef travel found today? and Why did people f un ffom the_bul1s? The 
• vocabulary ques.Jdris eontairi Words or phrases already a part of the student's 

oral iccabulary (e.g. busy, ehase, fight back the tears); Hence a student does 
Ss^t have to read the passages to derive the word meanings. Questions in the 
affective category may elicit a word association such as !hat between 'no and sad , 
or feel -and go5d w hich could accbunt;for "the number of correct responses. Samuels 
(1968) notes that strength of word association is often a salient feature in 
children's' gWssi'ng behavior. Examples of questions in ttiis category include: 
How did'the fhildren feel? and How do you thirik Mike filt when mother said no? 
These data suggest that the type of question asked- can^ signal the extent to which 
it might be passage fndependent. , , 

Conclusion • . 



An evaluation of thesfe three informal reading inventories has pointed out 
significant differences between and among the tests with re.gard to passage 
independence, 6haracteristips of passage independent questions and the potential 

■ to inflate composite comprehension scores. While a passage independeney analysis 
appears ^ necessary in eval uatinf the validity of reading comprehension tests. It . 
is not, sufficient; As Hanna and Oaster 0978-19791 point out, passage independence 
is not the complement of passagfe dep^ndeffce. That is, an" item which cannot he 
answered correctly when the passage is not read may not be able to be cdrrectly"" , 
answered :after reading the passage.- Hence, in Ahe'construction of future comprehen- 
sion tests OG the. revision of existing -measures, authors^ill^want to thoroughly 

• evaluate test questions to identify Both passage dependent and independent 
eharaeteristics. Certainly.. the best 'way to identify these characteristics is to ^ 
pilot the.passages and questions on a prototybieal. population, of students for which 
the test is designed. The present investigatioh completes the passage independency. 

_ • _' I 

faeet of this evaTyat>ion process; . . ^ . \ 
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TABLE 1 ft 



PASSAGE ikdEPENDENT TEST QUESTIONS 



Test 



CRI 



^Gor^rect Res pons 
/ 



ARI 



Ginn 720 



P 
1 
1 



2 
4 
4 
2 

5 
6 



11 



75 
TOO 
70 

79 

75 ^ 
-75° 
91. 
79 

92 
92 
83 

75 



/ 



- Qu.es t i on - 

Row did the children feel? 

Where do ants live? 

What does the word "busy" 
mean in the story? 

Why Uid the people 'run- - 
^ the bulls? 

What does the word "chase" 
mean? 

What made riding in a 
cones toga wagon unpleasant 

What are some ways of • 
travel found today?" 

What is meant by the phrase 
"fight baefc the tears?" 

c 

How do you think Mike felt . ' 
when mother, said no? 

Do the ariimals like living 
in the tree? 

What do you think the 
blackbird will do with 
the hat? 

What kind cf person do you * . 
xthink Mr, Green is? 



an = 12 

Note. 0,hly 

were rejsbrted. 



questions which 70% or more of the students answered correctly 
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